On three duality results 

M. D. Voisei* and C. Zfilinescu^ 



The aim of this short note is to give counterexamples to two results by D. Y. Gao [5j Th. 
16], [H Th. 2] and to improve a related result by S.-C. Fang, D. Y. Gao, R.-L. Sheu and S.-Y. 
Wu [H Th. 3]. 



1 Counterexamples to P Th. 16], |H, Th. 2] 

On [5] page 298] the authors consider the problem 

ll mm{P(x) = \x T Ax-fx : \x T Cx < A, x G K n }. (8.156)" 
"...where A and C are two symmetrical matrices in ]R nxn , / G W 1 is a given vector, and A £ R 
is a given constant", and continue on the following page with: "On the dual feasible space 

V* k = {<; G R | q > 0, det(A + <&) + 0} 
and the canonical dual problem (8.155) can be formulated as (see [50]): 

max \P d (s) = ~\f T {A + ?C) -1 / - A? : ? G V fc *} . (8.158)" 

"The following result was obtained recently. 

Theorem 16 (Gao [50]) Suppose that the matrix C is positive definite, and ? G V„ is a 
critical point of P d (q). If A + qC is positive definite, the vector 
x = (A + qC)- 1 f 

is a global minimizer of the primal problem (8.156). However, if A + qC is negative definite, 
the vector x = (A + qC)~ 1 f is a local minimizer of the primal problem (8.156)." 

In the previous statement = [0, +oo) (see [U p. 297]) while reference [50] is our reference 
[3[. This first result we are interested in is cited in [5] as being published in [3]; however, we 
could not find its statement in [3]. The following is a counterexample for [5l Th. 16]. 



Example 1 Consider 
A = 



C 



1 
1 



Then P d (y) 



1 2y-Z 

2 y*-5y+5 



and (P d Y(y) 



l 

2 ( y 2_ 5? , +5 ) 



2 (y — l)(y — 5). Hence the set 



of critical points of P is {1,2,5} all contained in V%. For y = 1 we have that A + yC 



is negative definite and x = (A + yC) 1 / = [ 1 
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Let Uq := {(cos t, sint) T | t G (— vr,7r)} be a subset of the admissible set IA = {x G M 2 | 
||x|| < 1} and 

f(t) := P((cos t, sint) T ) = — 1 — cos t sin t — ^ sin 2 t + cos i + sini = —(3 + cos t — 2 sint) sin 2 ^t, 

f 6 M; hence P(x) = /(0) = = P d (y). According to the previous theorem x should be local 
minimizer of P on U, in contradiction to the fact that t = is a strict local maximum point 
of f (see Figure 1). 



fffl 



\ 




Figure 1. 



Our attention turns to the problem considered in [3] 

"(P) : mm{P(x) = U{k{x)) + Q{x) : x G lZ n } (5)" 
where u Q(x) = ^x T Ax — c T x is a quadratic function, A = A T G TZ nxn is a given symmetric 
matrix", c G TZ n , and the so called "geometrical operator A : lZ n — > TZ 1+n and the associated 
canonical function U can be introduced as following: 

1 I D^|2 



U(y) = ±e + *(e) (3) 
where 

*(0 = ( ° if i-°' (4)" 
[ +oo otherwise. 

Here "B G TZ mxn is a given matrix and q > is a given parameter" while £ = {£j} G lZ n , 
li > 0. "The notation \x\ used in this paper denotes the Euclidean norm of x". 
"The canonical dual problem of (V) can be proposed as the following 

(V d ) : sta [P d (^, a) = -\c T [G(s, a)]" 1 c - ± ? 2 - a? - fa : (?, a) T G S a ) . (11) 

Here "G(?, <r) is a symmetrical matrix, defined by 
G{q,a) = A + qB T B + 2Diag(a) G K nxn , (9) 
and Diag(cr) G TZ nxn denotes a diagonal matrix with {a{\ (i = 1,2, ... ,ra) as its diagonal 

entries" while "S a = {y* = ( ? ) G TZ 1+n \ q > -a, a > 0, det G(?, <r) ^ 0}. (10)" 

One continues with "we need to introduce some useful feasible spaces: 
5+ = {(<j,c) T G S a | G(q,a) is positive definite}, (16) 
S~ = {(<j,cj) t G S a | G(s,a) is negative definite}. (17) 

Theorem 2 (Triality Theorem). Suppose that the vector y* = (q,a) T is a KKT point of 
the canonical dual function P d (y*) and x = [G(?, o r )]~ 1 c. 

If y* = (^, o 7 ) 7 G <S^~, then y* is a global maximizer of P d on <S+, the vector x is a global 
minimizer of P on X a , and 
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P(x) = min P(x) = max P d (y*) = P d (y*). (18) 

If y* S S~ , on the neighborhood X x S C X a x S a of (x, y*), we have that either 

P{x) = min P(x) = min P d (y*) = P d (y*) (19) 

xgA'o y*&S 

holds, or 

P{x) = maxP(x) = max P d {y*) = P d (y*)- (20)" 

Recall that "X a = {x G lZ n \ £ l < x < £ u } is a feasible space" and "we assume without loss 
of generality that £ u = -l l = £2 = {^/£~} (if necessary, a simple linear transformation can be 
used to convert the problem to this form)." 

A few remarks are necessary at this moment. 

• Note that in U Th. 2] the meaning of u y* = (?,a) T is a KKT point of (P d )" is not 
explained. However, due to the fact that the constraints of problem (V d ) are expressed 
via S a , if y* £ intS a is a critical point of P d (that is, VP d (y*) = 0) then y* is a KKT 
point. 

• It is not clear whether the neighborhood X x S Q is "a priori" prescribed or the statement 
should be understood in the sense that there exists such a neighborhood. In any case the 
example below shows that [H Th. 2] is false. The proof of this Triality Theorem in [3] 
begins with "In the canonical form of the primal problem (5), replacing U(A(y)) by the 
Fenchel- Young equality (A(x)) T y* — U^(y*) : the Gao-Strang type total complementary 
function (see [22]) associated with (V) can be obtained as 'E(x,y*) = ^x T G(q,a)x — 
U\y*) — x T c — — £ T a. (21)". For the proof of the second part of the theorem one 
says: "On the other hand, if y* £ S~ , the matrix G(?, a) is negative definite. In this 
case, the total complementary function H(x,y*) defined by (21) is a so-called super- 
Lagrangian (see [12]), i.e., it is locally concave in both x S X Q C X a and y* G S Q C S a . 
Thus, by the triality theory developed in [12], we have either 

P(x) = min P(x) = min max H(x, A) = min maxS(i, A) = min P d (y*), 
xex xex y*es y*es xex s/*e<s 

or 

P(x) = maxP(x) = max max H(x, A) = max maxS(x, A) = max P d (y*). 

x£X x£X y*eS y*£S x£X J/*G<So 

This proves the statements (19) and (20)." 

The references [22] and [12] mentioned above are our references [6] and [2], respectively. 
Therefore the second part of the conclusion for [H Th. 2] does not follow from a specific 
results with assumptions that can be verified but from "the triality theory". 

Example 2 Let n = 2, A = -AI 2 , B = I 2 , c= (-2, -2) T , a = 3 ; £ = (4,4) T . We have that 

P{s, t) = -2s 2 - 2t 2 + 2s + 2t + i (is 2 + \t 2 - 3) 2 , 

and the restrictions are s 2 <A,t 2 < 4, that is X a = [-2, 2] 2 . Also, 

Then y* = (1,1, 1) T E int5 a andy* £ S~ since G({1, 1, 1) T ) = —I2, y* is a KKT point of 
P d because VP d ((l, 1, 1) T ) = andy* G intS a , andx= [G((l, 1, l) T )] _1 c = -c = (2, 2) T £ 
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X a . Note that P(x) = P d ((l, 1, 1) T ) = -15/2. On one hand, for 7 G (0,1) we have that 
(2 - 7, 2 - 7) T G X a and 

P((2 - 7, 2 - 7 ) T ) = " y + ^7 4 " 4 7 3 + 5 7 2 + 87 > P(z), 

which shows that x is not a maximum point of P on any neighborhood of x G X a . Hence 
relation (20) in the above theorem does not hold. 
On the other hand, for 7 G (0, 1) we have that 

P d ((l - I67, 1 + 7 7 , 1 + 7 7 ) T ) = ~- 16^r (I67 + 7) < P d ((l, 1, If), 

2 27 + I 

which shows that y* G int5 a is not a local minimum point of P d . Hence relation (19) in the 
above theorem does not hold, too. Therefore, M Th. 2] is false. 

2 On a theorem in |1] 

Reference [1] begins with: "In this paper, we consider a simple 0-1 quadratic programming 
problem in the following form: 

(V) : min /max{P(x) = \x T Qx — f T x \ x G X a }, (1) 
where x and / are real n- vectors, Q G M nxn is a symmetrical matrix of order n and 

X a = {x G R n I < Xi < 1, i = 1,2, ... ,n} Dl n . (2) 
with r = {i£ M. n I Xi is an integer, i = 1,2, .. . , n}", continued with "By the definition of 
A(x) and V\<t), we have 

E(x,a) = \x T Q d {a)x-x T {f + 0-), (8) 
where 

Qd(o-) = Q + 2Diag(a) 

and Diag(cr) G R nxn ia a diagonal matrix with o"j, i = 1, 2, . . . , n, being its diagonal elements" 
and 

"P d {o-) = -\{f + o-) T Q~ d \o){f + a). (9)" 

Moreover, "we introduce the following four sets for consideration: 
S+ = {a G W 1 I a > 0, Q d {a) is positive definite}, (22) 
S~ = {a G W 1 I a > 0, Q d {a) is negative definite}, (23)" 
(we omit the other two sets). 

"Then we have the following result on the global and local optimality conditions: 

Theorem 3. Let Q be a symmetric matrix and / G W 1 . Assume that W is critical point 
of P d (a) andx = [Q d (a)]- 1 (f + a). 

(a) If a G then x is a global minimizer of P(x) over X a and a is a global maximizer 
of P d (a) over St with 

P(x) = min P(x) = max P d (a) = P d {a). (26) 

(b) If ~a G <Sr, then x is a local minimizer of P{x) over X a if and only if a is a local 
minimizer of P d (a) over SI~, i.e., in a neighborhood ^„ x 5,, C ^ x 5^" of (x,a), 

P(x) = min P(x) = min P d (o-) = P d {a). (27)" 

Note that because X a is a discrete set any x G X a is a local minimum point for P on Af a , 
as well as a local maximum point of P. In fact the following stronger statement is true. 
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Theorem 3 Let Q be a symmetric matrix and f E R n . Assume that a is critical point of P d 
such that detQdt/f) 7^ 0, and x := [QdO?)] -1 (/ + o 1 )- ITien x E Af a and P(x) = H(x, a 7 ) = 

(a) IfaE i/ien a is a global maximizer of P d over St and x is a global minimizer of 
P over X : = [0, l] n ; in particular, x is a global minimizer of P over X a = {0, l} n . 

(b) If a E , then x is a local minimizer of P over X and a is a global minimizer of P d 
over S7 . 

Note that the first part of the above theorem practically covers Theorems 1 and 2 in [1]. 

Proof. It is obvious that H(x, •) is affine (hence concave and convex) for every x £ M. n , 
H(-j cr) is convex for a E 5^", and H(-, cr) is concave for cr E 57. Note that 

V x E(x,a) =Q d (a)x - (f + a), V a E(x, a)(v) = x T Diag(v)x - x T v W E 1"; (1) 

it follows that V CT H(x, a) = if and only if x? — Xj = for every i E l,n, that is, x E Af a . 
Furthermore, due to the fact that a critical point of a convex function is a global minimum 
point, we have 

p»(*) = z([Q d {*THf + *U) = l mina:eRn * { ?' a \ * a lf (2) 

I max ieRn s(x,cr) if a E Sj, . 

Recall the fact that the operator (p : {U E DJl n | f7 invertible} — > 9Jl n defined by <p(U) = U~ l 
is Frechet differentiable and d<p(U)(S) = -U^SU" 1 for U, S E IR nxn with U invertible, where 
9Jt n is the (normed) linear space ofnxji real matrices. Also, we have dQ d {a){v) = 2Diag(t>) 
and so, on S a = {a E R n \ det Q d {a) + 0}, d\Q d (o)Y x (v) = -2 [Q^a)]" 1 Diag(t-) [Q d {a)\- 1 
and 

dP d (cr)M = - v T [Qdio-T 1 (/ + a) + (/ + a) T [^(a)]- 1 Diag(z;) [Q^a)]" 1 (/ + a), (3) 
d 2 P d (cr)K «) = - v T [Qdia)}- 1 v + 4v T [Q^a)}- 1 Diag(t;) [Q^)]" 1 (/ + a) 

- 4(/ + af [QdioT 1 Diag(^) [Q^a)]- 1 Diag(t;) [Q^)]" 1 (/ + a) (4) 

for all »eR" 

Since a E 5 a is a critical point of P d we have that dP d (a) = 0. Taking into account ([I]), 
we obtain from ([3]), using a direct computation, that V CT E(x, a) = 0, and sox£X a cX. 
Moreover, since xf = x, 

P(x) = \x T Qx — f T x = \x T Q d {a)x — x T f — x T Diag(cf)x 
= 2^ Qd\p)x — x f — x a = S(x, a) 

= \{f + v) T [Q d (v)]- l (f + - * T (/ + ff) = 

It is clear that S^" and are open convex sets because a — >■ Q d (o~) is affine. 

If ^4 := [(^(ct)]™ 1 is positive definite, setting «; := Diag(-u) [Qd(o")] _1 (/ + a) we have for 
every v E M n that 

d 2 P d (a){v, v) = -v T Av + 4v T Aw - Aw 7 'Aw = -{v - 2w) T A(v - 2w) < 0, 
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i.e. d 2 P d (a) is seminegatively definite. Hence P d is concave on St . Similarly, P d is convex 
on 57. 

(a) Let a G . Since E(x,a) = P(x) + YA=i a i( x i ~ x i) — -P( x )> f° r ever Y c > 0, 
x G [0, l] n and taking ([2]) into account we get 

P d (&) < sup P d {<r) = sup minH(x,cr) < sup inf E(x,o") 

<xeS+ ^5+^" «t>0*6[0,1]» 

< inf supH(x,cr) < inf P{x) < P(x). 
xe[o,i] n cr>o xe[o,i] n 

Therefore P d (a) = max ffe5 + P d (a) and P(x) = min^o,!.]" P( x )i since i-*(x) = P d (a). 

(b) Take now <r G 57"- Since P d is convex on 57 and a is a critical point of P d , clearly a 
is a global minimizer of P d on 57. 

Consider x & X. Since Qx — f = a — 2 Diag(ef)x, we get 

P{x) = \x T Qx — f T x = \{x — x) T Q(x — x) + (x — x) T Qx + ^x T Qx — f T x 



2 

P(x) + \{x - x) T Q{x -x) + (x- x) T Qx -{x- x) T f 



= P(x) + |(x - x) T Q(x - x) + - 2xi)(xi - x^ = P(x) + ^2ni(xi - x { ), 

i=l i=l 

where Q = {^} and m := Wi(l - 2xj) + \ YTj=\ Hj( x j ~ 

Let e > be such that min ke Y^, &k > § emax j j&Tn Take £7 = {x G M n | |x, — Xj| < 
e Vi G 1, n}. Then ~ ^™ =1 Qij(xj -Xj)(xi —Xi) > -§e|x, -x { \ max-^^ for every i G 1, n 
and x G £7, while the inequality <fj(l — 2x"j)(xj — Xj) > |xj — Xj| min fce y^ <7/% for every i G 1, n 
and x G £7 D X is easily checked, since Xj G {0, 1}. This shows that /ij(xj — Xj) > for every 
i G l,n, whence -P(x) > P(x) for every x G £7 fl X; therefore, x is a local minimizer of P on 
X. 
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